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Abstract. Quantitative languages are an extension of boolean languages that as- 
sign to each word a real number. Mean-payoff automata are finite automata with 
numerical weights on transitions that assign to each infinite path the long-run av- 
erage of the transition weights. When the mode of branching of the automaton is 
deterministic, nondeterministic, or alternating, the corresponding class of quan- 
titative languages is not robust as it is not closed under the pointwise operations 
of max, min, sum, and numerical complement. Nondeterministic and alternating 
mean-payoff automata are not decidable either, as the quantitative generalization 
of the problems of universality and language inclusion is undecidable. 
We introduce a new class of quantitative languages, defined by mean-payoff 
automaton expressions, which is robust and decidable: it is closed under the 
four pointwise operations, and we show that all decision problems are decidable 
for this class. Mean-payoff automaton expressions subsume deterministic mean- 
payoff automata, and we show that they have expressive power incomparable to 
nondeterministic and alternating mean-payoff automata. We also present for the 
first time an algorithm to compute distance between two quantitative languages, 
and in our case the quantitative languages are given as mean-payoff automaton 
expressions. 



1 Introduction 

Quantitative languages X are a natural generalization of boolean languages that assign 
to every word w a real number L{w) £ M instead of a boolean value. For instance, 
the value of a word (or behavior) can be interpreted as the amount of some resource 
(e.g., memory consumption, or power consumption) needed to produce it, or bound the 
long-run average available use of the resource. Thus quantitative languages can specify 
properties related to resource-constrained programs, and an implementation La satis- 
fies (or refines) a specification Lb if La{w) < Lb{w) for all words w. This notion of 
refinement is a quantitative generalization of language inclusion, and it can be used to 
check for example if for each behavior, the long-run average response time of the sys- 
tem lies below the specified average response requirement. Hence it is crucial to identify 
some relevant class of quantitative languages for which this question is decidable. The 
other classical decision questions such as emptiness, universality, and language equiva- 
lence have also a natural quantitative extension. For example, the quantitative emptiness 
problem asks, given a quantitative language L and a threshold ly £ Q, whether there ex- 
ists some word w such that L{w) > v, and the quantitative universality problem asks 



whether L{w) > v for all words w. Note that universality is a special case of language 
inclusion (where La{w) = is constant). 

Weighted mean-payoff automata present a nice framework to express such quanti- 
tative properties [3]. A weighted mean-payoff automaton is a finite automaton with nu- 
merical weights on transitions. The value of a word w is the maximal value of all runs 
over w (if the automaton is nondeterministic, then there may be many runs over w), 
and the value of a run r is the long-run average of the weights that appear along r. 
A mean-payoff extension to alternating automata has been studied in [4]. Determinis- 
tic, nondeterministic and alternating mean-payoff automata are three classes of mean- 
payoff automata with increasing expressive power However, none of these classes is 
closed under the four pointwise operations of max, min (which generalize union and 
intersection respectively), numerical complement"*, and sum (see Table 1). Determinis- 
tic mean-payoff automata are not closed under max, min, and sum [5] ; nondeterministic 
mean-payoff automata are not closed under min, sum and complement [5]; and alter- 
nating mean-payoff automata are not closed under sum [4]. Hence none of the above 
classes is robust with respect to closure properties. 

Moreover, while deterministic mean-payoff automata enjoy decidability of all quan- 
titative decision problems [3], the quantitative language-inclusion problem is undecid- 
able for nondeterministic and alternating mean-payoff automata [9], and thus also all 
decision problems are undecidable for alternating mean-payoff automata. Hence al- 
though mean-payoff automata provide a nice framework to express quantitative proper- 
ties, there is no known class which is both robust and decidable (see Table 1). 

In this paper, we introduce a new class of quantitative languages that are defined 
by mean-payoff automaton expressions. An expression is either a deterministic mean- 
payoff automaton, or it is the max, min, or sum of two mean-payoff automaton ex- 
pressions. Since deterministic mean-payoff automata are closed under complement, 
mean-payoff automaton expressions form a robust class that is closed under max, min, 
sum and complement. We show that (a) all decision problems (quantitative empti- 
ness, universality, inclusion, and equivalence) are decidable for mean-payoff automaton 
expressions; (b) mean-payoff automaton expressions are incomparable in expressive 
power with both the nondeterministic and alternating mean-payoff automata (i.e., there 
are quantitative languages expressible by mean-payoff automaton expressions that are 
not expressible by alternating mean-payoff automata, and there are quantitative lan- 
guages expressible by nondeterministic mean-payoff automata that are not expressible 
by mean-payoff automata expressions); and (c) the properties of cut-point languages 
(i.e., the sets of words with value above a certain threshold) for deterministic automata 
carry over to mean-payoff automaton expressions, mainly the cut-point language is w- 
regular when the threshold is isolated (i.e., some neeighborhood around the threshold 
contains no word). Moreover, mean-payoff automaton expressions can express all ex- 
amples in the literature of quantitative properties using mean-payoff measure [1,5,6]. 
Along with the quantitative generaUzation of the classical decision problems, we also 
consider the notion of distance between two quantitative languages La and Lb, defined 
as sup^ I La (w) — Lb{w)\. When quantitative language inclusion does not hold between 
an implementation La and a specification Lb, the distance is a relevant information to 



The numerical complement of a quantitative languages L is —L. 
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Table 1. Closure properties and decidability of the various classes of mean-payoff automata. 
Mean-payoff automaton expressions enjoy fully positive closure and decidability properties. 



evaluate how close they are, as we may accept implementations that overspend the re- 
source but we would prefer the least expensive ones. We present the first algorithm to 
compute the distance between two quantitative languages: we show that the distance 
can be computed for mean-payoff automaton expressions. 

Our approach to show decidability of mean-payoff automaton expressions relies on 
the characterization and algorithmic computation of the values set {LeIw) \ w £ S'^} 
of an expression E, i.e. the set of all values of words according to E. The value set can 
be viewed as an abstract representation of the quantitative language Le, and we show 
that all decision problems, cut-point language and distance computation can be solved 
efficiently once we have this set. 

First, we present a precise characterization of the value set for quantitative lan- 
guages defined by mean-payoff automaton expressions. In particular, we show that it is 
not sufficient to construct the convex hull conv(S'£;) of the set of the values of simple 
cycles in the mean-payoff automata occurring in E, but we need essentially to apply 
an operator i^min(-) which given a set Z C M" computes the set of points y S 
that can be obtained by taking pointwise minimum of each coordinate of points of a set 
X C Z. We show that while we need to compute the set Ve = Fniin(conv(S'£;)) to 
obtain the value set, and while this set is always convex, it is not always the case that 
F,jiin(conv(S'£;)) = conv(Fniin(S'£;)) (which would immediately give an algorithm to 
compute Ve)- This may appear counter-intuitive because the equality holds in but 
we show that the equality does not hold in M"^ (Example 2). 

Second, we provide algorithmic solutions to compute i^,„i,i(conv(5)), for a finite set 
S. We first present a constructive procedure that given S constructs a finite set of points 
S' such that conv(5') i^niin(conv(S')). The explicit construction presents interesting 
properties about the set F,„in(conv(5)), however the procedure itself is computationally 
expensive. We then present an elegant and geometric construction of i^,„in(conv(5)) as 
a set of linear constraints. The computation of i^„iin(conv(5)) is a new problem in 
computational geometry and the solutions we present could be of independent interest. 
Using the algorithm to compute Finin(conv(5)), we show that all decision problems for 
mean-payoff automaton expressions are decidable. Due to lack of space, most proofs 
are given in the appendix. 

' Closure under complementation holds because LimlnfAvg-automata and LimSupAvg- 
automata are dual. It would not hold if only LimlnfAvg-automata (or only LimSupAvg- 
automata) were allowed. 



Related works. Quantitative languages have been first studied over finite words in 
the context of probabiHstic automata [16] and weighted automata [17]. Several works 
have generalized the theory of weighted automata to infinite words (see [13, 11, 15,2] 
and [12] for a survey), but none of those have considered mean-payoff conditions. Ex- 
amples where the mean-payoff measure has been used to specify long-run behaviours of 
systems can be found in game theory [14, 19] and in Markov decision processes [7]. The 
mean-payoff automata as a specification language have been first investigated in [3, 5, 
4], and extended in [1] to construct a new class of (non-quantitative) languages of infi- 
nite words (the multi-threshold mean-payoff languages), obtained by applying a query 
to a mean-payoff language, and for which emptiness is decidable. It turns out that a 
richer language of queries can be expressed using mean-payoff automaton expressions 
(together with decidability of the emptiness problem). A detailed comparison with the 
results of [1] is given in Section 5. Moreover, we provide algorithmic solutions to the 
quantitative language inclusion and equivalence problems and to distance computation 
which have no counterpart for non-quantitative languages. Related notions of metrics 
have been addressed in stochastic games [8] and probabilistic processes [10, 18]. 

2 IVIean- Payoff Automaton Expressions 

Quantitative languages. A quantitative language L over a finite alphabet is a func- 
tion L : S'^ — > K. Given two quantitative languages Li and L2 over we denote by 
max(Li,L2) (resp., min(Li,L2), sum(Li,L2) and — Li) the quantitative language 
that assigns max(Li(u;), L2(io)) (resp., min(Li(i(j), L2(w)), Li{w) + L2{w), and 
—Li{w)) to each word w G S'^. The quantitative language — L is called the comple- 
ment of L. The max and min operators for quantitative languages correspond respec- 
tively to the least upper bound and greatest lower bound for the pointwise order < such 
that Li < L2 if Li{w) < L2{w) for all w € Thus, they generalize respectively the 
union and intersection operators for classical boolean languages. 

Weighted automata. A Q-weighted automaton is a tuple A = {Q, qj, S, S, wt), where 

- Q is a finite set of states, qi G Q is the initial state, and S isa finite alphabet; 

- SCQxSxQisa finite set of labelled transitions. We assume that S is total, i.e., 
for all g £ Q and a G S, there exists q' such that {q, a, q') € S; 

- wt : (5 — !■ Q is a weight function, where Q is the set of rational numbers. We assume 
that rational numbers are encoded as pairs of integers in binary. 

We say that A is deterministic if for all g G Q and a G S, there exists (g, cr, g') G (5 for 
exactly one q' G Q. We sometimes call automata nondeterministic to emphasize that 
they are not necessarily deterministic. 

Words and runs. A word w € is an infinite sequence of letters from E. A lasso- 
word w in Z"" is an ultimately periodic word of the form wi ■ W2 where wi G X"* is a 
finite prefix, and W2 S S'^ is nonempty. A run of A over an infinite word w ^ ai(72 ■ ■ ■ 
is an infinite sequence r = go(TigiO'2 • • • of states and letters such that (i) go = g/, and 
(m) (gi, (Ji+i, gi+i) G 5 for all i > 0. We denote by wt(r) = vqVi . . . the sequence of 
weights that occur in r where Vi — wt(gi, (jj+i, gj+i) for all i > 0. 



Quantitative language of mean-payoff automata. The mean-payoff value (or limit- 
average) of a sequence v ~ vqVi ... of real numbers is either 



Note that if we delete or insert finitely many values in an infinite sequence of numbers, 
its limit-average does not change, and if the sequence is ultimately periodic, then the 
LimlnfAvg and LimSupAvg values coincide (and correspond to the mean of the weights 
on the periodic part of the sequence). 

For Val G {LimlnfAvg, LimSupAvg}, the quantitative language La of A is defined 
by La{w) = sup{Val(wt(r)) | r is a run of A over w} for all w G 17". Accordingly, 
the automaton A and its quantitative language La are called LimlnfAvg or LimSupAvg. 
Note that for deterministic automata, we have La{w) = Val(wt(r)) where r is the 
unique run of A over w. 

We omit the weight function wt when it is clear from the context, and we write 
LimAvg when the value according to LimlnfAvg and LimSupAvg coincide (e.g., for 
runs with a lasso shape). 

Decision problems and distance. We consider the following classical decision prob- 
lems for quantitative languages, assuming an effective presentation of quantitative lan- 
guages (such as mean-payoff automata, or automaton expressions defined later). Given 
a quantitative language L and a threshold G Q, the quantitative emptiness problem 
asks whether there exists a word w G such that L{w) > v, and the quantitative 
universality problem asks whether L{w) > v for all words w G 17". 

Given two quantitative languages L\ and Li, the quantitative language-inclusion 
problem asks whether L\(w) < Liiw) for all words w G S'^, and the quantitative 
language-equivalence problem asks whether Li{w) = Liiw) for all words w G S'^. 
Note that universality is a special case of language inclusion where ii is constant. 
Finally, the distance between Li andi2 is Dsup{Li, L2) = sup.^^^^^\Li{w) — L2{w)\. 
It measures how close is an implementation ii as compared to a specification L-z- 

It is known that quantitative emptiness is decidable for nondeterministic mean- 
payoff automata [3], while decidability was open for alternating mean-payoff automata, 
as well as for the quantitative language-inclusion problem of nondeterministic mean- 
payoff automata. Recent undecidability results on games with imperfect information 
and mean-payoff objective [9] entail that these problems are undecidable (see Theo- 
rem 5). 

Robust quantitative languages. A class Q of quantitative languages is robust if the 
class is closed under max, min, sum and complementation operations. The closure 
properties allow quantitative languages from a robust class to be described composi- 
tionally. While nondeterministic LimlnfAvg- and LimSupAvg-automata are closed un- 
der the max operation, they are not closed under min and complement [5]. Alternating 
LimlnfAvg- and LimSupAvg-automata^ are closed under max and min, but are not 
closed under complementation and sum [4] We define a robust class of quantitative 

^ See [4] for the definition of alternating LimlnfAvg- and LimSupAvg-automata that generalize 
nondeterministic automata. 




languages for mean-payoff automata which is closed under max, min, sum, and com- 
plement, and which can express all natural examples of quantitative languages defined 
using the mean-payoff measure [1, 5, 6]. 

Mean-payoff automaton expressions. A mean-payoff automaton expression E is ob- 
tained by the following grammar rule: 

E::^ A \ ma.x{E,E) \ mm{E,E) \ sum{E,E) 

where ^ is a deterministic LimlnfAvg- or LimSupAvg-automaton. The quantitative lan- 
guage Lb of a mean-payoff automaton expression E is Le = La if E = A is sl 
deterministic automaton, and Le = op(L_Ei , i^^) if i? = op(£'i,£'2) for op G 
{max, min, smu}. By definition, the class of mean-payoff automaton expression is 
closed under max, min and sum. Closure under complement follows from the fact that 
the complement of max(£'i, E2) is min(— —E2), the complement of min{Ei, E2) 
is max(— — i?2), the complement of sum(i?i,i?2) is sum(— — £'2), and the 
complement of a deterministic LimlnfAvg-automaton can be defined by the same au- 
tomaton with opposite weights and interpreted as a LimSupAvg-automaton, and vice 
versa, since — limsup(wo, vi, ■ ■ ■) = liminf(— wq, —vi, . . .). Note that arbitrary linear 
combinations of deterministic mean-payoff automaton expressions (expressions such 
as ciEi + C2E2 where ci, C2 G Q are rational constants) can be obtained for free since 
scaling the weights of a mean-payoff automaton by a positive factor |c| results in a 
quantitative language scaled by the same factor. 

3 The Vector Set of Mean-Payoff Automaton Expressions 

Given a mean-payoff automaton expression E, let Ai, . . . , An be the determin- 
istic weighted automata occurring in E. The vector set of E is the set Ve = 
{{Lai (w), . . . , La„ (w)) £ R" I w G 17" } of tuples of values of words according 
to each automaton Ai. In this section, we characterize the vector set of mean-payoff 
automaton expressions, and in Section 4 we give an algorithmic procedure to compute 
this set. This will be useful to establish the decidability of all decision problems, and 
to compute the distance between mean-payoff automaton expressions. Given a vector 
V G M", we denote by ||w|| = max^ \vi\ the 00-norm of v. 

The synchronized product of Ai, A„ such that yl^ = (Q,, g}, Z", (5^, wt^} is the 
Q"-weighted automaton A^; ~ AiX- ■ - xAn = (Qi x • ■ • x Qn, (g), . . . , g"), S, S, wt) 
such that t = {{qi, . . . ,qn),<J,{q'i, . ■ ■ ,qn)) G Sift, ;= {q^,i7,q[) G (5i for all 
1 < i < n, and wt(t) = (wti(ti), . . . , wt„(t„)). In the sequel, we assume that all Ais 
are deterministic LimlnfAvg-automata (hence, Ae is deterministic) and that the under- 
lying graph of the automaton Ae has only one strongly connected component (sec). We 
show later how to obtain the vector set without these restrictions. 

For each (simple) cycle pin Ae, let the vector value of p be the mean of the tuples 
labelling the edges of p, denoted Avg{p). To each simple cycle p in Ae corresponds a 
(not necessarily simple) cycle in each Ai, and the vector value (wi , . . . , u„) of p contains 
the mean value Vi of p in each Ai. We denote by Se the (finite) set of vector values of 
simple cycles in Ae- Let conv(5_E) be the convex hull of Se- 
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Fig. 1. The vector set of E — max(^i, A2) is Fmin(conv(SB)) 3 conv(5'B). 

Lemma 1. Let E be a mean-payoff automaton expression. The set cony{SE) is the 
closure of the set {Le{w) \ w is a lasso-word}. 

The vector set of E contains more values than the convex hull conv(S'£;), as shown 
by the following example. 

Example 1. Consider the expression E = max(Ai, A2) where Ai and A2 are deter- 
ministic LimlnfAvg-automata (see Fig. 1). The product Ae ^ Ai x A2 has two sim- 
ple cycles with respective vector values (1, 0) (on letter 'a') and (0, 1) (on letter '6'). 
The set H = conv(S'£;) is the solid segment on Fig. 1 and contains the vector values 
of all lasso-words. However, other vector values can be obtained; consider the word 
w = a^^b"^a'^^b""^ . . . where rii = 1 and rii+i = (711 + • ■ • + n^)^ for all i > 1. It is 
easy to see that the value of w according to Ai is because the average number of a's in 
the prefixes a"i 6"^ . . . a"' for i odd is smaller than "^+'''+"' — = 1 ^ 

r mH hrii+ni+i 1+riiH h"; 

which tends to when i 00. Since Ai is a LimlnfAvg-automaton, the value of w is 
in Ai, and by a symmetric argument the value of w is also in ^2- Therefore the 
vector (0, 0) is in the vector set of E. Note that z = (0, 0) is the pointwise minimum 
of X = (1,0) and y = (0, 1), i.e. (0,0) = /,„i„((l,0), (0, 1)) where z = fnunix,y) if 
Zi = min(xi, yi) and Z2 = min(j/i, 7/2)- In fact, the vector set is the whole triangular 
region in Fig. 1, i.e. Ve = {/min(a;, y) \ x,y E conv(S'£;)}. 

We generahze /,„in to finite sets of points P C R" in n dimensions as fol- 
lows: /min(-P) G is the point p = {pi,p2, ■ . ■ ,Pn) such that pi is the minimum 
2* coordinate of the points in P, for 1 < i < n. For arbitrary S C M", define 
-Fmin(5') = {/min(^') | -P is a finite subset of 5*}. As illustrated in Example 1, the next 
lemma shows that the vector set Ve is equal to i^,„in(conv(S'£;)). 

Lemma 2. Let E be a mean-payoff automaton expression built from deterministic 
LimlnfAvg-flMtomaffl, and such that Ae has only one strongly connected component. 
Then, the vector set of E is Ve = i^min(conv(5£;)). 

For a general mean-payoff automaton expression E (with both deterministic 
LimlnfAvg- and LimSupAvg automata, and with multi-sec underlying graph), we can 
use the result of Lemma 2 as follows. We replace each LimSupAvg automaton Ai 
occurring in E by the LimlnfAvg automaton A[ obtained from Ai by replacing ev- 
ery weight wt by — wt. The duality of liminf and limsup yields La'. — —LAi- In 



each strongly connected component C of the underlying graph of Ae, we compute 
Vc = F,„in(conv(5c)) (where Sc is the set of vector values of the simple cycles in C) 
and apply the transformation Xi — > —Xi on every coordinate i where the automaton Ai 
was originally a LimSupAvg automaton. The union of the sets IJ^^ Vc where C ranges 
over the strongly connected components of Ae gives the vector set of E. 

Theorem 1. Let E be a mean-payojf automaton expression built from deterministic 
LimlnfAvg-aw/omato, and let Z be the set of strongly connected components in Ae- 
For a strongly connected component C let Sq denote the set of vector values of the 
simple cycles in C. The vector set of E is Ve = [Jcez ^rain(conv(S'c)). 

4 Computation of Fmin(conv(5)) for a Finite Set S 

It follows from Theorem 1 that the vector set Ve of a mean-payoff automaton expres- 
sion E can be obtained as a union of sets Fmi„(conv(S')), where S C M" is a fi- 
nite set. However, the set conv(S') being in general infinite, it is not immediate that 
-Fmm(conv(S')) is computable. In this section we consider the problem of computing 
-Pniin(conv(S')) for a finite set S. In subsection 4.1 we present an explicit construction 
and in subsection 4.2 we give a geometric construction of the set as a set of linear 
constraints. We first present some properties of the set Fmin(conv(S')). 

Lemma 3. If X is a convex set, then i^niin(-^) is convex. 

By Lemma 3, the set Fniin(conv(S')) is convex, and since Fmin is a monotone oper- 
ator and S C conv(S'), we have i^min(»S') ^ ^min(conv(5)) and thus conv(Finin(S')) C 
^'min(conv(5)). The following proposition states that in two dimensions the above sets 
coincide. 

Proposition 1. Let S CR^ be a finite set. Then, conv(Finin(S')) = Fniin(conv(S')). 

We show in the following example that in three dimensions the above proposition 
does not hold, i.e., we show that i^„iin(conv(S'£;)) ^ conv(Fmi„(S'£;)) in R"^. 

Example 2. We show that in three dimension there is a finite set S such that 
F„ii„(conv(5)) 2 com{F^US))- Let S = {g,r,s} with q = (0,1,0), r = 
(-1,-1,1), and s = (1,1,1). Then fniin{r,s) = r, fmin{q,r,s) = /min(g,'") = 
t = ( — 1, — 1, 0), and /miii(g, s) ~ (7. Therefore Fi„in(S') = {g, s, t}. Consider 
p = (r + s)/2 = (0,0,1). We have p e conv(S') and /min(p,g) = (0,0,0). 
Hence (0,0,0) G Fmin(conv(S')). We now show that (0,0,0) does not belong to 
conv(i^niin(S')). Consider u = aq-q+ar-r+ag-s + aft such that u in conv(Finin(S')). 
Since the third coordinate is non-negative for q, r, s, and t, it follows that if > or 
as > 0, then the third coordinate of u is positive. If = and a,. = 0, then we have 
two cases: (a) if at > 0, then the first coordinate of u is negative; and (b) if at = 0, 
then the second coordinate of u is 1. It follows (0, 0, 0) is not in conv(F,nin(S')). □ 



4.1 Explicit construction 



Example 2 shows that in general Finin(conv(5)) % conv(Finin(S')). In this section we 
present an explicit construction that given a finite set S constructs a finite set S' such 
that (a) C 5' C conv(5) and (b) Fn,in(conv(S')) C conv(^;„i„(S")). It would follow 
that -Finin(conv(5')) = conv(Fniin(>5")). Since convex hull of a finite set is computable 
and i^minCS") is finite, this would give us an algorithm to compute i^,„in(conv(S')). For 
simplicity, for the rest of the section we write F for Fmin and / for /min (i.e., we drop 
the mill from subscript). Recall that F(S) = {f{P) \ P finite subset of S} and let 
FtiS) = {f{P) I P finite subset of S and |P| < i}. We consider S C M". 

Lemma 4. Let S C M". Then, F{S) = F„{S) and F„{S) C F^'~\S). 

Iteration of a construction 7. We will present a construction 7 with the following 
properties: input to the construction is a finite set Y of points, and the output j{Y) 
satisfies the following properties 

1. (Condition CI). 7(1^) is finite and subset of conv(F). 

2. (Condition C2).F2(conv(y)) C conv(i^(7(y))). 

Before presenting the construction 7 we first show how to iterate the construction to 
obtain the following result: given a finite set of points X we construct a finite set of 
points X' such that F{com{X)) = com{F{X')). 

Iterating 7. Consider a finite set of points X, and let Xq — X and Xi — '^{Xq). Then 
we have 

conv(Xi) C conv(conv(Xo)) (since by Condition CI we have Xi C conv(Xo)) 

and hence conv(Xi) C conv(Xo); and 

F2(conv(Xo)) C conv(i^(Xi)) (by Condition C2) 

By iteration we obtain that Xi = 7(Xi_i) for i > 2 and as above we have 

(1) conv(Xj) C conv(Xo) (2) F^{com{Xo)) C conv(F(X,)) 

Thus for Xn-i we have 

(1) conv(X„_i) C conv(Xo) (2) F^-\cons/{Xo)) C conv(F(X„_i)) 

By (2) above and Lemma 4, we obtain 

(A) F(conv(Xo)) = ^^„(conv(Xo)) C F^-\conv{Xo)) C conv(^^(X„_i)) 

By (1) above we have conv(X„_i) C conv(Xo) and hence i^(conv(X„_i)) C 
F(conv(Xo)). Thus we have 



conv(i^(conv(X„_i))) C conv(i^(conv(Xo))) = F{con\/{Xo)) 



where the last equaHty follows since by Lemma 3 we have F(conv(Xo)) is convex. 
Since X„_i C conv(X„_i) we have 

(B) conv(_F(X„_i)) C conv(F(conv(X„_i))) C i^(conv(Xo)) 

Thus by (A) and (B) above we have F(conv(Xo)) = conv(i^(X„_i)). Thus given the 
finite set X, we have the finite set X„_i such that (a) X C Xn-i C conv(X) and 
(b) F{com{X)) = conv(F(X„_i)). We now present the construction 7 to complete 
the result. 

The construction 7. Given a finite set Y of points Y' — j{Y) is obtained by adding 
points to Y in the following way: 

- For all 1 < A: < n, we consider all fc-dimensional coordinate planes iJ supported 
by a point in Y; 

- Intersect each coordinate plane 7J with conv(y ) and the result is a convex polytope 
Yn; 

- We add the corners (or extreme points) of each polytope Yn to Y. 

The proof that the above construction satisfies condition CI and C2 is given in the 
appendix, and thus we have the following result. 

Theorem 2. Given a finite set S C R" such that \S\ = m, the following assertion 
holds: a finite set S' with \S'\ < m^" . 2"'+" can be computed in mO("-2") ■ 20("') 
time such that (a) S Q S' C conv(S') and (b) i^min(conv(S')) = conv(i^inin(S")). 

4.2 Linear constraint construction 

In the previous section we presented an explicit construction of a finite set of points 
whose convex hull gives us Fniin(conv(5)). The explicit construction illuminates 
properties of the set Fmin(conv(S')), however, the construction is inefficient compu- 
tationally. In this subsection we present an efficient geometric construction for the 
computation of Fmin(conv(5)) for a finite set S. Instead of constructing a finite set 
S' C conv(S') such that conv(S") ~ i^,„i,i(conv(S')), we represent Fmin(conv(S')) as a 
finite set of linear constraints. 

Consider the positive orthant anchored at the origin in E", that is, the set of points 
with non-negative coordinates: M" = {{zi, Z2, ■ ■ ■ , Zn) \ Zi > 0,Vi}. Similarly, the 
negative orthant is the set of points with non-positive coordinates, denoted as M" = 
— . Using vector addition, we write y + M" for the positive orthant anchored at y. 
Similarly, we write x + M" = x — M" for the negative orthant anchored at x. The 
positive and negative orthants satisfy the following simple duality relation: x E y + M" 
iffy e x-K.\. 

Note that M" is an n-dimensional convex polyhedron. For each 1 < j < n, we 
consider the [n — 1) -dimensional face Lj spanned by the coordinate axes except the 
one, that is, Lj — {{zi,Z2, ■ ■ ■ , Zn) G M" | zj = 0}. 

We say that y -t- is supported by X if (^y -\- ILj ) D X ^ for every 1 j 1^ ^. 
Assuming y + R" is supported by X, we can construct a set F C X hy collecting 
one point per {n — 1) -dimensional face of the orthant and get y — f{Y). It is also 



allowed that two faces contribute the same point to Y. Similarly, if ?/ = f{Y) for a 
subset Y <Z X, then the positive orthant anchored at y is supported by X. Hence, we 
get the following lemma. 

Lemma 5 (Orthant Lemma), y e Fniin(-^) iffy + R+ is supported by X. 

Construction. We use the Orthant Lemma to construct i^,„in(X). We begin by describ- 
ing the set of points y for which the face of the positive orthant anchored at y has 
a non-empty intersection with X. Define Fj — X — Lj, the set of points of the form 
X ~ z, where x ^ X and z G Lj . 

Lemma 6 (Face Lemma). {y + l^j)r\X^0iffyeFj. 

Proof. Let x G X he a point in the intersection, that is, x E y + hj . Using the duality 
relation for the (n — 1) -dimensional orthant, we get y E x — hj . By definition, x — hj 
is a subset of X — Lj, and hence y E Fj. □ 

It is now easy to describe the set defined in our problem statement. 
Lemma 7 (Characterization). Fniin(-'^) = n"=i ^j- 

Proof. By the Orthant Lemma, y E Fn-iin{X) iff y + M" is supported by X. Equiva- 
lently, {y + hj) D X for all 1 < j < n. By the Face Lemma, this is equivalent to 
y belonging to the common intersection of the sets Fj ^ X — hj . □ 

Algorithm for computation of i^,„i„(conv(S')). Following the construction, we get an 
algorithm that computes i^i„in(conv(S')) for a finite set S of points in M". Let |5| = m. 
We first represent X = conv(S') as intersection of half-spaces: we require at most m" 
half-spaces (linear constraints). It follows that Fj ^ X — Lj can be expressed as m" 
linear constraints, and hence Fa^iniX) ~ 0^=1 be expressed as n ■ m" linear 

constraints. This gives us the following result. 

Theorem 3. Given a finite set S ofm points in K", we can construct in 0{n ■ m") time 
n ■ m" linear constraints that represent i^„ii,i(conv(5)). 



5 Mean-Payoff Automaton Expressions are Decidable 

Several problems on quantitative languages can be solved for the class of mean-payoff 
automaton expressions using the vector set. The decision problems of quantitative 
emptiness and universality, and quantitative language inclusion and equivalence are all 
decidable, as well as questions related to cut-point languages, and computing distance 
between mean-payoff languages. 



Decision problems and distance. From the vector set Ve = { {Lai (w) , . . . , La„ (w)) G 
R" I w e Z"^}, we can compute the value set Le{S'^) = {Le{w) \ w e Z""} 
of values of words according to the quantitative language of E as follows. The set 
Le{S'^) is obtained by successive application of min-, max- and sum-projections 
P5'''>P'r''>Pfj'° : M*^ ^ R*^-! where i < j < k, defined by 

. . ■,Xk)) = {xi, . . .,Xi-i,iJim{xi,Xj),Xi+i,. . .,Xj-i,Xj+i, . ..Xk), 

Pij ( ('^l ' • ■ • ' *^^)) — (^l^-'-^'^z— 1; Xi Xj , Xi^i , . . . , Xj — i , Xj^i 1 ■ • ■ Xk ) , 

and analogously for p™''''. For example, p"2''^(p23"(^£)) gives the set Le{S'^) of word 
values of the mean-payoff automaton expression E ~ max(Ai, min(A2, A3)). 

Assuming a representation of the polytopes of Ve as a boolean combination (pE of 
linear constraints, the projection p™'"(Ve) is represented by the formula 

ip = (3xj : ifiE /\ Xi < Xj) V {3xi : ipE /\Xj < Xi)[xj 4- .t,;] 

where [x e] is a substitution that replaces every occurrence of x by the expression 
e. Since linear constraints over the reals admit effective elimination of existential quan- 
tification, the formula ij} can be transformed into an equivalent boolean combination 
of linear constraints without existential quantification. The same applies to max- and 
sum-projections. 

Successive applications of min-, max- and sum-projections (following the structure 
of the mean-payoff automaton expression E) gives the value set Le{S'^) C R as a 
boolean combination of linear constraints, hence it is a union of intervals. From this set, 
it is easy to decide the quantitative emptiness problem and the quantitative universality 
problem: there exists a word w G 17" such that Le{w) > if and only if Le{S'^) n 
[v, +oo[^ 0, and Le{w) > v for all words w G Z"^ if and only if L£;(Z") n] - 
00, v\ ~ 0. 

In the same way, we can decide the quantitative language inclusion problem "is 
Le{w) < Lf{w) for all words w g Z"" ?" by a reduction to the universality problem 
for the expression F — E and threshold since mean-payoff automaton expressions are 
closed under sum and complement. The quantitative language equivalence problem is 
then obviously also decidable. 

Finally, the distance between the quantitative languages of E and F can be com- 
puted as the largest number (in absolute value) in the value set of F — i7. As a corollary, 
this distance is always a rational number. 

Comparison with [1]. The work in [1] considers deterministic mean-payoff automata 
with multiple payoffs. The weight function in such an automaton is of the form wt : 
6 Q'^. The value of a finite sequence (wj;)i<i<,i (where Vi G Q'') is the mean of the 
tuples Vi, that is a d-dimensional vector Avg„ = i • J2"=o '^i- The "value" associated 
to an infinite run (and thus also to the corresponding word, since the automaton is 
deterministic) is the set Acc C R'' of accumulation points of the sequence (Avg„)„>i. 

In [1], a query language on the set of accumulation points is used to define multi- 
threshold mean-pay ojf languages. For 1 < i < n, let pi : R" — ^ R be the usual projec- 
tion along the i* coordinate. A query is a boolean combination of atomic threshold con- 
ditions of the form min(pi(Acc)) ^ v or max(pi(Acc)) ^ v where ~e {<, <, >, >} 



and v ^ Q. A word is accepted if the set of accumulation points of its (unique) run satis- 
fies the query. Emptiness is decidable for such muhi-threshold mean-payoff languages, 
by an argument based on the computation of the convex hull of the vector values of the 
simple cycles in the automaton [1] (see also Lemma 1). We have shown that this convex 
hull conv(5£;) is not sufficient to analyze quantitative languages of mean-payoff au- 
tomaton expressions. It turns out that a richer query language can also be defined using 
our construction of Fnjin(conv(S'£;)). 

In our setting, we can view a d-dimensional mean-payoff automaton A as a product 
Pa of 2d copies Al of A (where 1 < i < d and t 6 {LimlnfAvg, LimSupAvg}), where 
Al assigns to each transition the coordinate of the payoff vector in A, and the au- 
tomaton is interpreted as a t-automaton. Intuitively, the set Acc of accumulation points 
of a word w satisfies mm(pi{Acc)) ^ i' (resp. ma.x{pi{Acc) ~ v) if and only if the 
value of w according to the automaton Al for t ~ LimlnfAvg (resp. t = LimSupAvg) is 
~ v. Therefore, atomic threshold conditions can be encoded as threshold conditions on 
single variables of the vector set for Pa - Therefore, the vector set computed in Section 4 
allows to decide the emptiness problem for multi-threshold mean-payoff languages, by 
checking emptiness of the intersection of the vector set with the constraint correspond- 
ing to the query. 

Furthermore, we can solve more expressive queries in our framework, namely where 
atomic conditions are linear constraints on LimlnfAvg- and LimSupAvg-values. For ex- 
ample, the constraint LimlnfAvg(wti) + LimSupAvg(wt2) ^ is simply encoded as 
Xk+xi ly where k, I are the indices corresponding to Al-^^^f^^^ and ^LimSupAvg re- 
spectively. Note that the trick of extending the dimension of the d-payoff vector with, 
say wtd+i = wti+wt2, is not equivalent because Lim{1nP}Avg(wti)±Lim{1nP}Avg(wt2) 
is not equal to Lim'uUf }Avg(wti ± wt2) in general (no matter the choice of {IT} and ±). 
Hence, in the context of non-quantitative languages our results also provide a richer 
query language for the deterministic mean-payoff automata with multiple payoffs. 

Complexity. All problems studied in this section can be solved easily (in polynomial 
time) once the value set is constructed, which can be done in quadruple exponential 
time. The quadruple exponential blow-up is caused by (a) the synchronized product 
construction for E, (b) the computation of the vector values of all simple cycles in Ae, 
(c) the construction of the vector set i^min(conv(S'E)), and {d) the successive projec- 
tions of the vector set to obtain the value set. Therefore, all the above problems can be 
solved in 4EXPTIME. 

Theorem 4. For the class of mean-payojf automaton expressions, the quantitative 
emptiness, universality, language inclusion, and equivalence problems, as well as dis- 
tance computation can be solved in 4EXPTIME. 

Theorem 4 is in sharp contrast with the nondeterministic and alternating mean- 
payoff automata for which language inclusion is undecidable (see also Table 1). The 
following theorem presents the undecidability result that is derived from the results 
of [9]. 

Theorem 5. The quantitative universality, language inclusion, and language equiva- 
lence problems are undecidable for nondeterministic mean-payoff automata; and the 



quantitative emptiness, universality, language inclusion, and language equivalence 
problems are undecidablefor alternating mean-payojf automata. 

6 Expressive Power and Cut-point Languages 

We study the expressive power of mean-payoff automaton expressions (i) according to 
the class of quantitative languages that they define, and [ii) according to their cut-point 
languages. 

Expressive power comparison. We compare the expressive power of mean-payoff au- 
tomaton expressions with nondeterministic and alternating mean-payoff automata. The 
results of [5] show that there exist deterministic mean-payoff automata Ai and A2 such 
that miii(Ai , A2) cannot be expressed by nondeterministic mean-payoff automata. The 
results of [4] shows that there exists deterministic mean-payoff automata Ai and A2 
such that smTL(y4i, yl2) cannot be expressed by alternating mean-payoff automata. It 
follows that there exist languages expressible by mean-payoff automaton expression 
that cannot be expressed by nondeterministic and alternating mean-payoff automata. In 
Theorem 6 we show the converse, that is, we show that there exist languages expressible 
by nondeterministic mean-payoff automata that cannot be expressed by mean-payoff 
automaton expression. It may be noted that the subclass of mean-payoff automaton ex- 
pressions that only uses min and max operators (and no sum operator) is a strict subclass 
of alternating mean-payoff automata, and when only the max operator is used we get a 
strict subclass of the nondeterministic mean-payoff automata. 

Theorem 6. Mean-payoff automaton expressions are incomparable in expressive 
power with nondeterministic and alternating mean-payoff automata: (a) there exists 
a quantitative language that is expressible by mean-payoff automaton expressions, but 
cannot be expressed by alternating mean-payoff automata; and (b) there exists a quan- 
titative language that is expressible by a nondeterministic mean-payoff automaton, but 
cannot be expressed by a mean-payoff automaton expression. 

Cut-point languages. Let L be a quantitative language over S. Given a threshold 77 G 
K, the cut-point language defined by (L, 77) is the language (i.e., the set of words) 
L-"^' = {w E Z"" I L{w) > 77}. It is known for deterministic mean-payoff automata 
that the cut-point language may not be w-regular, while it is oj-regular if the threshold 77 
is isolated, i.e. if there exists e > such that \L{w) — rj\ > e for all words w G S'^ [5]. 

We present the following results about cut-point languages of mean-payoff automa- 
ton expressions. First, we note that it is decidable whether a rational threshold t] is 
an isolated cut-point of a mean-payoff automaton expression, using the value set (it 
suffices to check that 7/ is not in the value set since this set is closed). Second, iso- 
lated cut-point languages of mean-payoff automaton expressions are robust as they re- 
main unchanged under sufficiently small perturbations of the transition weights. This 
result follows from a more general robustness property of weighted automata [5] that 
extends to mean-payoff automaton expressions: if the weights in the automata occur- 
ring in E are changed by at most e, then the value of every word changes by at most 



max(fc, 1) • e where k is the number of occurrences of the sum operator in E. Therefore 
-Dsup(i_B, Lpe) — s> when e ^ where is any mean-payoff automaton expression 
obtained from E by changing the weights by at most e. As a consequence, isolated cut- 
point languages of mean-payoff automaton expressions are robust. Third, the isolated 
cut-point language of mean-payoff automaton expressions is w-regular. To see this, note 
that every strongly connected component of the product automaton contributes with 
a closed convex set to the value set of E. Since the max-, min- and sum-projections 
are continuous functions, they preserve connectedness of sets and therefore each sec C 
contributes with an interval [mc , Mq] to the value set of E. An isolated cut-point rj 
cannot belong to any of these intervals, and therefore we obtain a Biichi- automaton for 
the cut-point language by declaring to be accepting the states of the product automaton 
Ae that belong to an sec C such that mc > rj. Hence, we get the following result. 

Theorem 7. Let L be the quantitative language of a mean-payoff automaton expres- 
sion. Ifij is an isolated cut-point of L, then the cut-point language L-^ is ui-regular. 

7 Conclusion and Future Works 

We have presented a new class of quantitative languages, the mean-payoff automaton 
expressions which are both robust and decidable (see Table 1), and for which the dis- 
tance between quantitative languages can be computed. The decidability results come 
with a high worst-case complexity, and it is a natural question for future works to either 
improve the algorithmic solution, or present a matching lower bound. Another question 
of interest is to find a robust and decidable class of quantitative languages based on the 
discounted sum measure [3]. 
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A Proofs of Section 3 



Proof (of Lemma 1 ). Let Ai , . . . , A„ be the deterministic weighted automata occurring 
in^;. 

First, let x e conv(5£;). Then, x ~ X^iLi ^i'^i where vi,V2, ■ ■ ■ ,Vp are the vector 
values of simple cycles pi, p2, Pp in Ae = Ai x • • • x An, and J2^=i ^ 1 ^i'^^ 
A,; > for all 1 < i < p. 

For each of the above cycles pi, let qi be a state occurring in pi, and let /Oi->j be a 
simple path in A^; connecting qi and (such paths exist for each I < i, j < p because 
Ae has a unique strongly connected component). Let po^i be a simple path in A^; 
from the initial state qj to qi. Note that the length of pi and Pi-i-j is at most m = \Ae\ 
the number of states in Ae- We consider the following sequence of ultimately periodic 
paths, parameterized by G N; 



PN = PO^I • (Pi' • Pl^2 ■ ■■■■ Pp" ■ Pp^lT, 



where fci^ = 



for all 1 < i < p. Note that pat is the run of a lasso-word w;^ in 

Ae, and that N ■ X, ~ \p,\ < \p,\ ■ < N ■ A,. 

Because pat is ultimately periodic, the vector value of p^ gives the value of wjv in 
each Ai. It can be computed as 



LimAvg(pAr) = l^^g{Pi ■ P\^i ■ ■ ■ ■ ■ Pp" ■ Pp^i) 



and it can be bounded along each coordinate = 1, . . . , n as follows (we denote by W 
the largest weight in A^; in absolute value): 



LimAvg,(p^) < p p^ 



Y^k^ ■\p.\ + Y.\'^e\ 

i=l i=l 

P 

-Xi- Avgj(pi) +p-m-W 
j2N-K-\p,\ + \AE\ 

i=l 

N-Xj-\-p-m-W p-m-W 
- N ^ ^1 ^ N 



< 



Analogously, we have 



j^k^ ■\p^\■^ygM)-il\M■w 

LimAvg^.(pjv) > l^i p ^ 

i=l i=l 

P 

Y,{N ■\-\p,\)-kstg^{p,)^p-m-W 



Y,N-\, + \Ae\ 

i=l 

N-Xj~2p-m-W p-m-(2W-Xj) 
— N+p-m ~ N+p-m 

Therefore LimAvg^ (/5jv) — > xj when iV — > oo. This shows that x is in the closure 
of the vector set of lasso-words. 

Second, we show that the value of lasso words according to each automaton Ai form 
a vector which belong to conv(S'£;) (which is equal to its closure). Let w = ^1(^2)" be 
a lasso-word. It is easy to see that there exists pi , p2 suchthatp =pi+P2 <m = \Ae\ 
and the run of Ae on W1W2 has the shape of a lasso (i.e., the automaton Ae is in the 
same state after reading wi and after reading W1W2), and thus the cyclic part of the 
lasso can be decomposed into simple cycles in Ae- The vector value of w in each Ai is 
the mean of the vector values of the simple cycles in the decomposition, and therefore 
it belongs to the convex hull conv(5£). □ 



Proof (of Lemma 2). First, show that Ve ^ i^min(conv(5_E)). Let 2; G Ve be a tuple 
of values of some word w according to each automaton Ai occurring in E (i.e., Xi = 

{w) for all 1 < i < n). For e > and 1 < fc < n, we construct a lasso-word 
such that \LAk{we) ~ Xk\ < e and LAi{we) > Xi ~ e for all 1 < i < n with i ^ kAi 
we denote by the vector value of w^, then the value y = /min({2/e | 1 < < n}) is 
such that \yi — Xi\ < e for all 1 < A: < n. By Lemma 1, the limit of the vector value 
when e — > is in conv(S'E), and thus x G Finin(conv(5'£;)). 

We give the construction of for k = 1. The construction is similar for k > 2. 
Consider the word w and let p be the suffix of the (unique) run of Ae on w which visits 
only states in the strongly connected component of Ae- The value of p and the value of 
w coincide (according to each Ai) since the mean-payoff value is prefix-independent. 
Since . (w) = Xi for all 1 < i < n, there exists a position p G N such that the mean 
value of all prefixes of p of length greater than p is at least Xi — e according to each 
Ai (since each Ai is a LimlnfAvg-automata). Since La^ (w) — xi, there exist infinitely 
many prefixes p' of p with mean value according to Ai close to xi, more precisely such 
that |Avgj(p') — xil < e. Pick such a prefix p' of length at least max(p, i). Since p' 
is in the strongly connected component of Ae, we can extend p' to loop back to its 
first state. This requires at most m additional steps and gives p"- Note also that p" can 
be reached from the initial state of Ae since it was the case of p, and thus it defines a 



lasso-shaped run whose value can be bounded along the first coordinate as follows: 



|Avgi(p")-xi| < 



< 



I |f)'|-Avgi (p')-\p"\-xi\+m-W 

\p' \-\Avgi{p' }-xi\+{\p" \ -\p' \)-xi+m-W 



<e-{l + 2m-W) 

Hence, the value along the first coordinate of the word wl corresponding to the run p" 
tends to xi when when e 0. We show similarly that the value of wl along the other 
coordinates i > 2 is bounded from below by — e • (1 + 2m • W). The result follows. 

Now, we show that F„iin(conv(S'£;)) C Ve- In this proof, we use the notation 
for iterated concatenation defined as follows. Given nonempty words wi,W2 S , 
the finite word wi W2 is wi ■ (^2)*^ where k = We assume that (iterated 

concatenation) and • (usual concatenation) have the same precedence and that they are 
left-associative. For example, the expression a60a- 6 is parsed as (a60a)- 6 and denotes 
the word abaaaab, while the expression a5-a0 6 is parsed as (a6-a) 0fo and denotes the 
word abab^. We use this notation for the purpose of simplifying the proof presentation, 
and some care needs to be taken. For example, explicit use of concatenation (i.e., a ■ b 
vs. ab) makes a difference since abQ ab ~ (ab)^ while abG a ■ b ^ aba%. Finally, we 
use notations such as [wi ■ W2 0)" to denote the infinite word wi ■ W2 wi • W2 ■ • ■ • 

Usually we use the notation wi W2 when the run of on i^i • W2 can be decom- 
posed as pi ■ p2 where pi corresponds to Wi {i = 1, 2) and p2 is a cycle in the automaton. 
Then, the mean value of the run on wi 1112 is 

|Pi|-Avg(pi) + |pip-|p2|-Avg(p2) 

\Pl\ + IPiP • |P2 

^ Avg(pi) + ■ \P2 \ • Avg(p2) 

1+ |Pl| ■ \P2\ 

Avg(/?i) - Avg(p2) 



Avg(p2 



1 + |pi| • |P2 



Therefore, since |Avg(/9i) — Avg(p2)| < independently of wi and W2, a key prop- 
erty of is that the mean value of wi W2 can be made arbitrarily close to Avg(/92) 
by taking wi sufficiently long (since = |pi|). 

We proceed with the proof of the lemma. Let x G i^,„in(conv(5£;)) and let 
2/1, . . . , y„ be n points in conv(S'£;) such that the i* coordinate of x and yi coincide 
for all 1 < « < n, and the j* coordinate of x is smaller than the coordinate of yi for 
all j 7^ i. Such y/s exist by definition of i^min though they may not be distinct. 

By Lemma 1, for all e > there exist lasso- words lui suchthat ?/fe|| < 
e where Vk = {LAi{wk), . ■ . , LA^iwk)) for each 1 < k < n. For each 1 < i < n, let 



Pi be the cyclic part of the (lasso-shaped) run of Ae ovi Wi, and let qi be the first state 
in Pi. For each 1 < i, .7 < ti, define Pi^j the shortest path m Ae from qi to qj, and let 
Po^j be a simple path in from the initial state qi to qj (such paths exist because 
A^; is Strongly connected). Note that Avg j{pi) = i^i^ (w^). We construct the following 
infinite run in Ae- 

P = Pa^l {Pl ■ Pl^2 P2 ■ P2^3 Q ...Pn- Pn^l^T 

It is routine to show that /) is a run of Ae, and we have LimAvgj(/5) — vjj because 

(i) the cycles pi, . . . , p„ are asymptotically prevaihng over the cycle pi^2P2-^7iPn-¥i, 

[ii] by the key property of 0, there exist infinitely many prefixes in p such that the 
average of the weight along the j* coordinate converges to Vjj, and [Hi) all cycles pi 
have average value greater than Vjj along the j* coordinate. Therefore, the liminf of 
the averages along the coordinate (i.e., LimAvgj (p)) is Vjj, and the vector of values 
of p is thus at distance e of x, that is || LimAvg(/5) — a;|| < e. The construction of p can 
be adapted to obtain LimAvg(/5) = a; by changing the /c* occurrence of pi in /) by a 
cycle corresponding to a lasso- word Wi obtained as above for e < □ 

B Proofs of Section 4 

Proof (of Lemma 3). Let x = /niin(u^, w^, • ■ • , u") and y = /inin('y^, w^, . . . , "y") 
where m^, . . . , u", w^, . . . , G X. Let z = Ax + (1 — X)y where < A < 1 and 
we prove that z G i^min(^)- Without loss of generality, assume that Xi = u\ and 
yi = v\ for all 1 < i < n. Then Zi = Am* + (1 — X)v\ for all 1 < i < n. 

To show that z e F-iai-aiX), we give for each 1 < j < n a point p G X such that 
= Zj and pfc > Zfc for all k ^ j. Take p = + (1 — X)v^ . Clearly p G X since 
u-' , G X and X is convex, and (i) = Au^ + (1 — A)wj = Zj, and (ii) for all 

k ^ j, we have Wk = Aii-[, + (1 — A)w^ > \u\ + (1 — A)u^ = Zk (since vf' has the 
minimal value on fc* coordinate among u^, . . . , w", similarly for v^). □ 

Proof (of Proposition 1). By Lemma 3, we already know that conv(i^,„in(S')) C 
Fi„in(conv(S')) (the set i^,„in(conv(S')) is convex, and since Fmin is a monotone opera- 
tor and S C conv(S'), we have F„iin(5) C Fmin(conv(S')) and thus conv(i^,„i,i(S')) C 
F„i„(conv(5))). 

We prove that ^;„i„(conv(S')) C conv(Fmin(S')) if 5 C R^. Let x e 
Fi„in(conv(5')) and show that x G conv(Fmin(5)). Since x G Fmin(conv(S')), there 
exist p,q G conv(5') such that x = fmin{p,q), and assume thatpi < qi andp2 > 92 
(other cases are symmetrical, or imply that x ^ por x = q for which the result is trivial 
as then x G conv(5)). We show that x = {pi,q2) is in the convex hull of {p,q,r} 
where r = /min(u, v) and m G 5 is the point in S with smallest first coordinate, and 
V G S is the point in S with smallest second coordinate, so that ri = ui < pi and 
r2 = V2 < q2- Simple computations show that the equation .T = Xp + pq+ {1 — X — p,)r 
has a solution with < X, p < 1 and the result follows. □ 

Proof (of Lemma 4). By definition, we have Fn{S) C F{S). For a point x = f{P) 
for a finite subset PCS, choose one point each that contributes to a coordinate and 



obtain a finite set P' C P of at most n points such that x = f{P). This shows that 
F{S) C P„(5). 

For the second part, let P = {pi,p2, . . . ,pk} with k < n, and let x = f{P). Let 
= f{piiP2), and for i > 1 we define cc^ = We have x = x^-i 

(e.g., f{pi,P2,P3) = /(/(pi,P2),P3))- Thus we have obtained .t by applying / on two 
points for n~l times, and it follows that Fn{S) C FIl~'^{S). □ 

Proof (of Theorem 2). We show that the construction 7 satisfies condition CI and C2. 
Let y = "y{Y). Clearly the set Y' is a finite subset of conv(F) and thus Condition CI 
holds and we now show that Condition C2 is satisfied. 

Since F2(conv(y)) is convex (by Lemma 3), it suffices to show that all corners 
of F2(conv(F)) belong to conv(F(y)). Consider a point x = f{p,q) where p,q & 
conv(Y'). We will show that either p, q e Y' or x cannot be a corner of conv(F2(i^)). 
It will follow that F2(conv(F)) C conv(F(y)). Our proof will be an induction on 
the number of coordinates such that there is a tie (tie is the case where the value of a 
coordinate of p and q coincide). If there are n ties, then the points p and q are equal and 
we have x = p = q, and this case is trivial since Y C Y' . So the base case is done. 
By inductive hypothesis, we assume that k + 1-ties yield the result and we consider the 
case for fc-ties. Without loss of generality we consider the following case; 

Pi = qi;p2 = 92; • • • ;pk = qk; 

Pk+i < qk+i;Pk+2 < qk+2; ■■■ ;pi < qe; 

pe+i > qe+i;pe+2 > qe+2; • • • ;p„ > g„; 

i.e, the first k coordinates are ties, then p is the sole contributor to the coordinates fc + 1 
to £, and for the rest of the coordinates q is the sole contributor Below we will use the 
expression infinitesimal change to mean change smaller than rj = minfc<j;<„ |pi — qi\ 
(note 7] > 0). Consider the plane 77 with first k coordinates constant (given by xi = 
Pi = qi;x2 = P2 ^ q2': - ■ ■ :Xk = Pk = qk)- We intersect the plane 77 with conv(y) 
and we obtain a polytope. First we consider the case when p and q are not a corner of 
the polytope and then we consider when p and q are corners of the polytope. 

1. Case 1: p is not a corner of the polytope 77 fl conv(y). We draw a line in 77 with 
p as midpoint such that the line is contained in 77 n conv(F). This ensures that the 
coordinates 1 to fc remain fixed along the line. 

(a) If any one of coordinates from fc + 1 to £ changes along the line, then by 
infinitesimal change of p along the line, we ensure that x moves along a line. 

(b) Otherwise coordinates fc + 1 to £ remain constant; and we move p along the 
line in a direction such that at least one of the remaining coordinates (say j) 
decreases, and decreasing j we have one of the following three cases: 

i. we go down to qj and then we have one more tie and we are fine by induc- 
tive hypothesis; 

ii. we hit a face of the polytope 77 n conv(F) and then we change direction 
of the line (while staying in the hit face) and continue; 

iii. we hit a corner of the polytope 77 n conv(y) and then p becomes a corner 
which will be handled in Case 3. 



2. Case 2: q is not a corner of the polytope U n conv(y). By symmetric analysis to 
Case 1 either we are done or q becomes a corner of the polytope 77 n conv(F). 

3. Case 3: p and q are corners of the polytope U fl conv(y). If 77 is supported by 
Y, then both p,q Q Y' and we are done. Otherwise 77 is not supported by Y, and 
now we move along lines with p and q as midpoints and slide the plane 77. In other 
words we move p and q alone lines and move such that the ties remain the same. 
We also ensure infinitesimal changes along the Une so that the contributor of each 
coordinate is the same as original. Let 

p{X) = p + X ■ v; q{^) = q + fl ■ w; 

be the lines where v and w are directions. By ties for 1 < z < fc we have X ■ Vi = 
fl ■ Wi. Then for infinitesimal change the point x moves as follows: 

xiX,fi) = fipiX),qifi))) 

= {pi+ X - vi,p2 + X-V2,---Pe + X- ve,qe+i + fi ■ wi+i, ■■■ ,qn+ fi- w„) 

= {pi +X-vi,p2 + X-v2,---Pe + X-Vi,qe+i +X - ^ -Wf+i,--- ,q„ + X- ^■ 

It follows that X moves along the line x + X- z where for 1 < z < £ we have Zi ~ Vi 
and for £ < i < n we have Zi = ^ ■ Wi, note that wi > since the plane slides. 
Since x moves along a line it cannot be an extreme point. 

This completes the proof. Also note that in the special case when there is no tie at all 
then we do not need to consider Case 3 as then 77 = M" and thus p and q are corners 
of conv(y ) and hence in Y' . 

Analysis. Given a set of m points, the construction 7 yield at most ■ 2" points. 
The argument is as follows; consider a point p, and then we consider all fc-dimensional 
coordinates planes through p. There are (JJ) possible fc-dimensional coordinate plane 
through p, and summing over all k we get that there are at most 2" coordinate planes 
that we consider through p. The interesection of a coordinate plane through p with the 
convex hull of m points gives at most m new corner points, and this claim is as proved 
follows: the new corner points can be constructed as the shadow of the convex huU 
on the plane, and since the convex hull has m corner points the claim follows. Thus it 
follows that the construction yield at most m? ■ 2" new points, and thus we have at most 
m + m? • 2" < 2 • ■ 2" points. If the set S has m points, applying the construction 
iteratively for n times we obtain the desired set 5" that has at most w?" ■ 2" points. 
Since convex hull of a set of t points in n dimension can be constructed in £'^(") time, 
it follows that the set S' can be constructed in m'-'^'^'^ ^ ■ 2'^(" ^ time. □ 

Proof (Theorem 5 (Sketch)). We will show the undecidability for the quantitative uni- 
versality problem for nondeterministic mean-payoff automata. It will follow that the 
quantitative language inclusion and quantitative language equivalence problem are un- 
decidable for both nondeterministic and alternating automata. The quantitative uni- 
versality for nondeterministic automata can be reduced to the quantitative emptiness 
as well as the quantitative universality problem for alternating mean-payoff automata. 
Hence to complete the proof we derive the undecidability of quantitative universality 
for nondeterministic mean-payoff automata from the recent results of [9]. 



The results of [9] show that in two-player blind imperfect-information mean-payoff 
games whether there is a player 1 blind-strategy a such that against all player 2 strate- 
gies T the mean-payoff value P{(t, t) of the play given a and r is greater than i/ is unde- 
cidable. The result is a reduction from the halting problem of two-counter machines, and 
we observe that the reduction has the following property: for threshold value = 0, if 
the two-counter machine halts then player 1 has a blind-strategy to ensure payoff greater 
than J/, and otherwise against every blind-strategy for player 1, player 2 can ensure that 
the payoff for player 1 is at most = 0. Thus from the above observation about the 
reduction of [9] it follows that in two-player blind imperfect-information mean-payoff 
games, given a threshold ly, the decision problem whether 

3a. inf P((T, t) > v 

T 

where a ranges over player 1 blind-strategies, and r over player 2 strategies, is unde- 
cidable and dually the following decision problem whether 

Vct. sup P{a, t) > v 

T 

is also undecidable. The universality problem for nondeterministic mean-payoff au- 
tomata is equivalent to two-player blind imperfect information mean-payoff games 
where the choice of words represents the blind-strategies for player 1 and resolving 
nondeterminism corresponds to strategies of player 2. It follows that for nondetermin- 
istic mean-payoff automata A, given a threshold v, the decision problem whether 

for all words w. La{w) > v 

is undecidable. □ 



C Proofs of Section 6 

Proof {of Theorem 6). We prove the two assertions. 

1. The results of [4] shows that there exists deterministic mean-payoff automata Ai 
and A2 such that sum(Ai, A2) cannot be expressed by alternating mean-payoff 
automata. Hence the result follows. 

2. We now show that there exist quantitative languages expressible by nondetermin- 
istic mean-payoff automata that cannot be expressed by mean-payoff automaton 
expressions. Consider the language Lp of finitely many a's, i.e., for an infinite 
word w we have Lp{w) = 1 if w contains finitely many a's, and Lp{w) = oth- 
erwise. It is easy to see that the nondeterministic mean-payoff automaton (shown 
in Fig. 2) defines Lp. 

We now show that L^? is not expressible by a mean-payoff automaton expression. 
Towards contradiction, assume that the expression E defines the language Lp, and 
let Ap he the synchronized product of the deterministic automata occurring in E 
(assume Ap has n states). Consider a reachable bottom strongly connected com- 
ponent V of the underlying graph of Ap, and let C be a 6-cycle in V. We construct 



a, b,0 b,l a, b, 




Fig. 2. A nondeterministic limit-average automaton. 

an infinite word w with infinitely many a's as follows: {i) start with a prefix wi 
of length at most n to reach C, (ii) loop A: times through the b-cycle C (initially 
k = 1), (mi) read an 'a' and then a finite word of length at most n to reach C 
again (this is possible since C is in a bottom s.c.c), and proceed to step (ii) with 
increased value of k. 

The cycle C corresponds to a cycle in each automaton of E, and since the value 
of k is increasing unboundedly, the value of w in each automaton of E is given 
by the average of the weights along their 6-cycle after reading wi. Therefore, the 
value of w and the value of coincide in each deterministic automaton of E. 
As a consequence, their value coincide in E itself. This is a contradiction since 
Lpiw) = while Lpiwib'^) = 1. 

□ 



